This is a quantized version of the KAT-Dev model of Kwaipilot, processed using the imatrix quantization technology of llama.cpp, aiming to improve the running efficiency and performance of the model in different hardware environments. This version offers multiple quantization levels, from high quality to extreme compression, to meet different memory and computing resource requirements.

Natural Language ProcessingGguf

This is a quantized version of the Microsoft UserLM-8b model, using the imatrix quantization technology of llama.cpp. It can significantly reduce memory usage and improve inference speed while maintaining model performance. It supports multiple quantization levels, from high quality to extreme compression, suitable for different hardware environments.

Natural Language ProcessingGguf